Evaluating Apprentice Performance

following paragraphs on item type in making your decision
and writing items. Regardless of the type of test and kind of
test item you use, remember the following guidelines for
writing good tesE items:

1.   Avoid using ambiguous statements in any of the test
material;

2.   Avoid using vocabulary that is difficult or unrelated to
the desired learning outcome;

3.   Avoid using unclear directions;

4.   Avoid using complicated syntax or sentences; and

5.   Avoid providing unintended clues to the correct or
best answer.

Multiple-choice items

Multiple-choice items offer great flexibility for assessing
all types of performance outcomes because you as instructor
control the background Information, the alternative answers,
and the level of performance the apprentice must demon-
strate to answer the question correctly.

A multiple-choice item is made up of two parts. The first
part is called the stem. The stem is written as a question or
presentation. It provides the background information for
the test item as well as the specification of the type of
operation the apprentice must use to answer the item
correctly. The second part of the item is the set of alter-
native answers, one of which is either the correct answer or
the best answer for the problem presented. The other
alternative answers are called distractors. In the following
example, the stem and the alternatives are identified.

Stem; Which of the following types of non-verbal com-
munication usually conveys the most Information?

Alternatives;

a.    voice tone

b.    eye contact

c.    hand gestures

d.    posture

The major advantages of multiple-choice items are flexi-
bility and scoring ease, The major disadvantages are the
amount of time it takes to write good questions and the fact
that, occassionally, the correct or best answer will be
guessed by an apprentice who did not know the answer.
The rules you should follow when writing multiple-choice
The rules you should follow when writing multiple-choice
Items will simplify item construction and decrease the likeli-
hood of an apprentice correctly guessing the answers. The
rules are as follows:

1. Design each Item to measure an important learning
outcome. Ignore unimportant or irrelevant informa-
tion, Use the behavioral objectives to determine the
content areas of the Items.

2.   Present only one clearly formulated problem or
question in the stem. Explain exactly what is being
asked and include necessary information to answer
the question. Avoid unnecessary information. The
stem should be understood without looking at the
alternatives.

Example:

Poor stem: While evetyone processes information
rnentally at a different rate, what is the average
number of words per minute most people can
process?

Better stem: About how many words per minute
can the average person's mind process?

3.   Construct four (4) or five (5) alternative answers for
each stem. Be sure that only one alternative is correct
or represents the best possible answer.

4.   When possible avoid negatively stated items, either
in stems or alternatives. If negative construction is
used, emphasize the negative construction by under-
lining or capitalization.

Example:

Poor construction: Which of the following be-
haviors Is not a bad listening habit?

Better construction: which of the following be-
haviors is not a bad listening habit?

5.   Write each alternative so that it is grammatically
consistent with the item's stem. Also, try to make
each alternative approximately the same length as all
other alternatives,

Example:

Poor construction: When offering feedback to a
speaker after receiving a communication, you
should:

a.    describe what you saw and think you heard
so you deal with the facts

b.    focus on behavior and Individual personality

c.    focus on judgement and evaluation

Better construction: When offering feedback to a
speaker after receiving a communication, you
should:

a.    focus on description and observation

b.    focus on behavior and individual personality

c.    focus on judgement and evaluation

6.   Randomly use each alternative postltion for correct
answers in approximately equal numbers. Too fre-
quently test makers avoid the first and last positions
while concentrating on the middle position. ThisEvaluating Apprentice Performance
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